Szilard engine revisited; information from time forward and backward process 
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We derive the work performed in the Szilard engine (SZE) by using dissipative work formula of 
non-equilibrium thermodynamics developed in Kawai et al. Phys. Rev. Lett. 98, 080602 (2007). 
The work is described as the difference of probability distributions of measurement outcomes of the 
time forward and the backward process. 
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Szilard engine (SZE) is machinery that extracts me- 
chanical work from information pj. It is made up of an 
atom (or a molecule) contained in an isolated box. The 
thermodynamic cycle of the SZE consists of three steps 
as shown in Fig. [TJ (A) to insert a wall so as to divide a 
box into two parts, (B) to perform measurement to ob- 
tain information on which side the atom is in, and (C) to 
attach a weight to the wall to extract work via isother- 
mal expansion with a thermal reservoir of temperature T 
contacted. As the gas is expanded in a quasi-static way, 
the amount of extracted work is given as fcsTln2, where 
^ is a Boltzmann constant. 

The SZE was originally proposed to show the impor- 
tance of information in the context of Maxwell's demon 
[U, [![ . To avoid violating the second law of thermody- 
namics the entropy associated with (Shanon) informa- 
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FIG. 1: Schematic diagram of the thermodynamic processes 
of the SZE. Initially a single atom is prepared in an isolated 
box. (A) A wall denoted as a vertical grey bar is inserted 
to split the box into to two parts. The atom is represented 
by the dotted circles to reflect that we are lack of the infor- 
mation on which side it is before the measurement. (B) The 
measurement is performed, and one acquires the knowledge 
of where the atom is. (C) A load denoted by a hlled rectangle 
is attached to the wall to extract a work via an isothermal 
expansion at temperature T. 
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tion obtained via measurement process should play an 
equivalent role as physical (or Boltzmann) entropy p], H[ . 
In fact, the measurement is assumed to be performed by 
the Maxwell's demon. It had been shown that the de- 
mon can perform measurement reversibly since it can be 
modeled as one-bit memory in the SZE. The entropy of 
the engine is then transferred to the demon via measure- 
ment. As Landauer pointed out, erasure of the demon's 
memory should be followed in order to complete the ther- 
modynamic cycle of the engine jB;, 6]. Here the entropy 
is transferred from the demon to the environment, which 
is irreversible since the degree of freedom of the envi- 
ronment is large enough. The SZE has been revived in 
various contexts [l2T - [l4| , and realized in experiments [l5l - 
Il7ll . The non-equilibrium SZE has also been considered 

The work done by the SZE is directly associated with 
quantum measurement process, in which information en- 
tropy of In 2 is produced. Conventionally it has been be- 
lieved that this information forms a source of the SZE. If 
one considers the SZE consisting of more than one parti- 
cle, however, such a simple argument needs modification. 
In this paper we will show that more general statement 
on the source of work of the SZE can be made by using re- 
cent idea developed in non-equilibrium thermodynamics: 
the work of the SZE is given as the relativc-cntropy-likc 
formula of measurement outcomes of the time forward 
and the backward process. It clearly shows that the work 
formula of the quantum SZE derived recently poj has no 
quantum mechanical origin since it appears in a purely 
classical consideration. 

The pioneering work on non-equilibrium ther- 
modynamics has been done by Jarzynski 0]. 
Crooks then found his seminal fluctuation theorem, 
Pf(+w)/pb(—w) = e / 3 ( u '- AF ) ; where Pf(b) is the prob- 
ability density function of work in the time forward 
(backward) direction, and derived Jarzynski equality 
from it Q . This shows the work done during thermody- 
namic process is intimately related to the time forward 
and the backward protocol. Recently Kawai, Van den 
Broeck and Parrondo have found an expression of the 
average dissipated work {W) diss upon bringing a system 
from one canonical equilibrium state described by an 
external parameter A^ at a temperature T into another 
one described by As at the same temperature Q. The 
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dissipated work is defined as the extra amount of work 
done by a system, on top of the difference of free energy 
AF required for making this transition. It reads 



(W) 



diss 



(W) + AF = -k B TD(p || p), 



where 



D(p II p) 
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Here p = p(T,t) is the probability density in phase space 
to observe the system to be in a micro-state T = (q,p) 
specified by a set of positions q and momenta p at an 
intermediate time t. The other density p = p(T; t) 
represents the distribution in the time-reversed process 
observed at a corresponding time-reversed phase point 
f = (q,—p) at t measured in the forward process 
D(p || p) in Eq. is called as the relative entropy quan- 
tifying the difference between two distributions p and p 

m- 

If there exists some constraints on the initial state, 
which is imposed by selection or filtering processes; for 
example, an available phase space is restricted to T a over 
T, Eq.([T|) is modified as 



(W) + AF = -k B T\n 



p(fi 



k B TD{p || p), (3) 



where p(Ta) denotes the probability to select the ini- 
tial condition within a phase space volume Ta for the 
forward process, i.e. p(Ta) = Z(T, Xa] Ta)/Z(T, Xa) in 
equilibrium, while p(Tb) = Z(T,Xb',^b)/Z(T,Xb) for 
the backward (Tlj . Here the partition function is de- 
fined as Z(T,X,D) = J D aTexp[-H(T,X)/k B T}, where 
H(T, X) is a Hamiltonian. 

Although the original SZE consists of only one atom, 
we will consider A^-particle SZE since our interpreta- 
tion becomes more transparent in many particle case. 
The thermodynamic processes of the SZE are accordingly 
modified. At first, we obtain 2 N outcomes rather than 2 
from the measurement. Note that the particles are distin- 
guishable as classical mechanics is considered. For sim- 
plicity we assume that all the measurement is performed 
perfectly. How the imperfect measurement modifies the 
results of the SZE has been investigated in Ref. [2l| . The 
probability to find r particles in the left side after a wall 
is inserted at the center of the one-dimensional box of 
size L is given as 



p(N,r) 



-N 



(4) 



which is related to p(Ta) in Eq. (3). The wall then moves 
to undergo isothermal expansion so that the engine does 
work until it reaches x = rL/N, which is equilibrium 
position. Finally the wall is removed to return to the 
initial state. In one-particle SZE, it is not necessary to 
remove the wall since the wall reaches the end of the box. 
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FIG. 2: Schematic diagram of the central part of thermody- 
namic processes of TV-particle SZE. After inserting a wall at 
x = L/2, N + 1 possible cases, namely r = 0, 1, • • • N, are 
obtained by the measurement. p(N,r) is determined by se- 
lecting the case encircled by the dashed box among JV+1 pos- 
sible ones. The isothermal expansion then brings the wall to 
x — rL/N. For the backward process, p*(N,r) is determined 
by selecting the case encircled by the dashed box, where the 
wall is located at x = rL/N . 



For the time reversed process, we start from N parti- 
cles in a box without the wall, which is the exactly same 
as the initial condition of the forward process. The wall is 
then inserted at x = rL/N. At this moment the number 
of particle in the left side can be any number ranging from 
to TV. We should select the r particle case since this 
is only correct time-reversed process as shown in Fig. [2] 
The probability to select such a specific case is given as 



P*(N,r) = [- 
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Now we derive the work performed by the SZE based 
upon Eq. (j3)). In order to exploit Eq. ((3]), the thermody- 
namic process from the initial to the final state should 
be undergone with the system isolated from the envi- 
ronment, where two states should have the same tem- 
perature Since the expansion process is performed 



isothcrmally, the system is not isolated but rather equi- 
librated with the reservoir at every moment. However, 
the quasi-static isothermal expansion process performed 
during the time interval [0,r a ] can be regarded as a col- 
lection of many consecutive isolated subprocesses, namely 
[0,e], [e, 2e], • • • , [(n-l)e, ne], ■ ■ ■ , and [r -e,r ] (e < r tt ) 
with n = 1, 2, • • • , M. Here at t = and at t = r a the 
expansion process starts and ends, respectively. It is em- 
phasized that at the end of each subprocess the system 
should contact the reservoir of temperature T to ensure 
that the isothermal condition is guaranteed. This is also 
necessary for exploiting Eq. (O 11]. We thus assume 
that Eq. §5§ is satisfied within each individual subpro- 
cess: 

(W n )+AF n = -k B T\n P j^ A ' n ] — k B TD(p„ || p~ n ). (6) 
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When the expansion is completed, the wall is removed 
at t = Tb(> To). It is not so crucial how fast the wall 
is removed in classical consideration, which is not true 
in quantum mechanics [2p| . We again need a relaxation 
process by contacting a reservoir of temperature T at a 
certain time t = t c (> Tfc). The reason is that although 
the wall is removed the distribution p(= p^) cannot cover 
whole accessible phase space given by the canonical dis- 
tribution of temperature T due to conservation of the 
phase volume followed by Liouville dynamics. Such an 
additional relaxation at the end of the cycle plays a cru- 
cial role in our consideration. This will be discussed in 
detail below. 

Now we consider each term appearing in Eq. ([3]) one 
by one. At first, the second term AF should vanish for 
one full cycle since the SZE is a cyclic engine, imply- 
ing that the initial state coincides with the final state. 
Secondly, one can show that p(TA, n +i) = p(Ts,n) is 
obeyed during [0,r a ] from the fact that at the end of 
each subprocess, namely t = ne, the system is equili- 
brated with the reservoir of temperature T. It leads us 

t0 X)n=l ln 2 5 ( r A,n)/p(f B,n) = ^P{^A,l) ~ lnj>(f b,n)- 

On the other hand, during [r a ,r c ] one finds p(T A,ac) = 
P{^b,n) and p(Tb.o,c) = 1, where the subscript ac de- 
notes a subprocess during [r a , r c ] . Thus one has merely 
— ksT \yip(Ta.i) or equivalently —kBT\np(N,r) for the 
thrid term of Eq. ([3]). Lastly, during [0,r a ] it is shown 
that 2n=i D{p n || p~ n ) vanishes as M —> oo. The rea- 
son is that as M — > oo the whole expansion process 
approaches true isothermal process, where p n = p~ n is 
satisfied. More rigorously one can prove 2 ra =i D{Pn II 
Pn) ~ 1/M. On the other hand, during [r a ,T c ] one finds 
Pac/Pac = l/p*(N,r) since (i) p ac is equal to p N , whose 
phase volume is confined in Ta determined from the mea- 
surement outcome r, and (ii) p ac is the canonical dis- 
tribution of temperature T at t = r c , which means it 
covers whole available phase volume T. Thus the fourth 
term of Eq. Q becomes simply +ksT\n.p*{N, r) due 
to D(p ac \\p ac ) = J dTp ac \n[l/p*(N,r)]. In fact, such an 
entropy production described by D(p ac \\p ac ) comes from 
the fact that the wall removal induces an irreversible pro- 
cess, namely free expansion. 

So far we have derived the work performed for the case 
that one specific selection, namely Ta or a measurement 
outcome r in our case, is made. The average work for all 
possible outcomes is then expressed as 



N 



(W) = -fc B T^p(iV,r)ln 



p(N,r) 
P* (N, r) ' 



(7) 



This looks like the relative entropy, but indeed it is 
not the case since p*(N,r) is not normalized, namely 
J2r=oP*(N,r) ^ 1. Note that this is distinguished from 
the following normalization condition. 
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In Eq. ([7]) p(N, r) is the selection probability of the for- 
ward measurement, while p*(N,r) corresponds to that 
of the backward if the measurement is assumed to be 
performed for the backward. It should be noted that 
originally p* (N, r) comes from the entropy production 
induced by removing the wall, i.e. D(p ac \\p ac ). 

In a trivial one-particle SZE, the well-known work, 
fcsT In 2, is retrieved from two probability distributions 
p(l,0) - p(l,l) = 1/2, and p*(l,0) - = 1 by 

using Eq. ([7]) since for the backward process the wall is 
inserted at x = (x = L), only r = (r = 1) can be 
selected. Conventionally the SZE performs work by ex- 
ploiting the entropy produced during the measurement of 
the forward process, where the backward is ignored. In 
one particle SZE, however, the contribution of the back- 
ward process is invisible. 

In two-particle SZE, the work is also given as fcsTln2 
from p(2,0) = p(2,2) = 1/4, p(2, 1) = 1/2, p*(2,0) = 
p*{2, 2) = 1, and p*{2, 1) = 1/2. In a conventional point 
of view, the information entropy produced by the mea- 
surement is ^2 r p(2, r) lnp(2, r) = 21n2, so that naively 
thinking it is expected that (W) = 2fcs7Tn2. However, 
in the case of r = 1 work cannot be generated because 
there is no pressure difference between two sides. Ac- 
cording to p(2, 1) = 1/2 the average work is thus given as 
fcsrin2 rather than 2fcsTln2. Since all the information 
entropy related to the forward measurement is not used 
for generating work, it is necessary to eliminate useless 
information for work. In fact, the selection probability 
of the backward process exactly plays a role of useless 
information. In this sense the SZE is machinery that ex- 
tracts work from the difference of information between 
the forward and the backward process. 

By using Eqs. dU and (|5|), Eq. (J7]) is rewritten as 

(W0=5>(A,7>(A,r) (9) 



with 



w(N,r)=Nk B T[ln2-b(r/N)], (10) 



where b(q) = —q ln q— (1 — q) ln(l — q) is a binary entropy 
function satisfying < b(q) < ln2. The entropy of the 
system decreases by ln2 due to the measurement, while 
it increases by b(q) when the wall is removed. The former 
is the information entropy, but the latter is the physical 
entropy divided by the Boltzmann constant, acquired by 
removing a partition. Net entropy change of the system 
is then given as the difference between these two, namely 
AS. The maximum work that the SZE can generate is 
then at best k B TAS, i.e. Eq. (fT0|). 

Eq. (fT0|) can also be retrieved from classical thermo- 
dynamic consideration as follows 



w(N,r) 



qL 



L/2 



V 



:dV 



{1 - q)L (N - r) 



L/2 



V 



dV, (11) 



where q denotes r/N. Here the first and the second term 
on the right-hand side represent the work done by the 
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gases in the left and the right side, respectively, during 
the isothermal expansion. However, from Eq. (jlip it may 
not be easy to draw information-theoretic interpretation 
presented in Eq. ([7]), i-e. the difference of information 
between the forward and the backward process. More 
importantly Eq. ([7} is still valid in the quantum version 
of the SZE, while Eq. flTTj! is not any longer 0. 

As N — > oo the work per a particle vanishes since it is 
approximated for N 3> 1 as 



N 



1 1 

2N 
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(12) 



This can be understood from the fact that it is almost im- 
probable to have considerable number- difference of par- 
ticles between two sides compared with 7V(^> 1) after 
inserting a wall. As a matter of fact, the maximum work 
is obtained from one-particle SZE. 

So far, for simplicity we have considered the wall is 
inserted at x — L/2 in the forward process. If we take 
X = d (0 < d < L) into account, Eqs.Q and (flO|) arc 
replaced by 



p(N,r) 



L-d 
L 



N-r 



(13) 



and w(N,r) = Nk B T [b(d/L) - b(r/N)], respectively. 
Thus the work is given as difference of two entropy func- 
tions of the forward and the backward process. 

Recently the formula of work performed by the quan- 
tum SZE is found based upon quantum thermodynamic 
approach (20| . This expression exactly coincides with 
Eq. ([Jj. In some sense this may not be surprising since 
Eq. (TT]) is proven to be valid in quantum mechanics 



[111 ]. However, this is not trivial because it was found 
that the work is required for inserting or removing a 
wall in quantum mechanics (20j even though no work 
is needed in classical case. The difference between the 
classical and the quantum SZE indeed lies at their parti- 
tion functions from which the probabilities p and p* are 
determined both in classical and in quantum mechan- 
ics, i.e. p(N,r) = Z N (r,d/L;T)/J2 r Z N {r,d/L;T) and 
p*(N,r) = Z N (r,rL/N;T)/J^ r Z N (r,rL/N;T), where 
Zjsr(r,x;T) denotes a A^-particle partition function de- 
scribing the case that r particles of temperature T exist 
in the left of the wall located at x. Different from classical 
mechanics, particles are identical in quantum mechanics, 
which dramatically affects the partition functions. It has 
been found that more (less) work can be extracted from 
the bosonic (fermionic) SZE compared with that of the 
classical SZE. Irrespective of such a marked difference 
the work formula has the equivalent form, i.e. Eq. (J7J, 
and the same physical interpretation. 

In conclusion we have shown that the work performed 
by many-particle SZE is given as the relative-entropy- 
like formula describing the difference of the probability 
distributions of the time forward and the backward pro- 
cess. This result comes from the dissipative work for- 
mula of non-equilibrium thermodynamics. The expres- 
sion obtained here is also valid in quantum mechanics. 
We believe our finings shed light on the subtle role of 
information in physics. 
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